Distributed composition of broadcast television programs

ABSTRACT

Described are methods and systems for combining programming content in a controlled synchronized manner. The systems and methods allow for centrally generated content to be modified using local content. The centrally generated content can include data that specifies what portions of the centrally generated content can be modified by the local content.

RELATED APPLICATIONS

This application claims the benefit of U.S. patent Pub. Ser. No.11/272,043, filed on Nov. 14, 2005, which claims benefit to provisionalapplication 60/627,084, filed Nov. 12, 2004, the entirety of which areincorporated herein by reference.

FIELD OF INVENTION

The present invention relates to methods and systems for combiningprogramming content in a controlled synchronized manner. The systems andmethods allow the combined content to be delivered simultaneously tousers as part of a standard programming signal.

BACKGROUND OF THE INVENTION

It is desirable for certain channels of television programming tocontain both national and local content elements. Traditionally, this isaccomplished by creating time slots during which each of the variouselements occupies. A conventional television distribution systemprovides a national (or regional) network feed, with time slots that areavailable for the insertion of locally generated content (or ads) at abroadcast network affiliate station or a cable headend and a means forsignaling the availability of a time slot for local insertion ofcontent. However, not every broadcast network affiliate station or cableheadend may have the equipment and/or the content available to perform alocal insertion, thus, common industry practice is to have a networkfeed contain promotional or other “filler” content which may be replacedby locally generated content, but which will be sent to the viewers incase such locally generated content is not available.

Some types of television programming such as news, weather, sports etc.tend to be more informational and lend themselves to the use of graphicsand text content elements to convey information to the viewer. Examplesinclude MSNBC and CNBC, which each use a particular layout format offull motion video with additional graphics and text elements in a formatthat is appropriate to their content. In such cases it is commonpractice to compose the programming by segmenting the screen intovarious windows of information. Such programming is produced anddistributed in a conventional way, with time slots available for localinsertion of content.

Conventional television productions segment the program into a videoportion and various graphics elements. But the segmentation of thescreen and the generation and overlay of the graphics elements is allperformed as part of the program production, that is, in the controlroom where the program is being produced. Conventionally, once a programleaves the control room it is considered “finished” and there is nochange made to it as it goes through various stages of distribution tothe consumer. Consequently, only the video information is typicallyconveyed through the distribution chain.

Accordingly, a need exists for an efficient way of combining nationaland local content in the same viewer screen at the broadcast networkaffiliate station or cable headend.

SUMMARY OF THE INVENTION

Methods and systems for combining programming content in a controlledsynchronized manner are provided. One embodiment is a method ofdistributing customizable program content. The method includesdistributing a program including multiple program segments configured tobe displayed simultaneously on different portions of a display, anddistributing data comprising an indication of which segments can besubsequently modified.

Preferably, the program is a television program or a web site.Preferably, the data also includes the location of one or more programsegments, the size of one or more program segments, or the duration ofone or more program segments.

Preferably, the data and the television program are distributedsimultaneously as part of the same program signal. The program signalmay be an analog or digital program signal. Preferably, the programsignal is in a compressed format, for example MPEG-2 format, and themultiple program segments are horizontally and vertically sized to havedimensions that are an integer multiple of a macroblock size, andwherein edges of the multiple program segments align with macroblockboundaries.

Preferably, the program is a nationally broadcast television program.Preferably, the method also includes modifying one or more programsegments. A preferred modification is replacing the one or more programsegments with local content. The modification may include modifying onlypart of one or more segments. Preferably, the modified program isdistributed to one or more users.

Another embodiment is a method of customizing program contentcomprising. The method includes receiving a program comprising multipleprogram segments configured to be displayed simultaneously on differentportions of a display, receiving data comprising an indication of whichsegments can be subsequently modified, and modifying one or moresegments to produce a modified program. Preferably, the modified programis distributed to one or more users. Preferably, it is distributed to aplurality of users. Preferably, the data and the television program arereceived simultaneously as part of the same program signal.

Yet another embodiment is a computer readable media having computerreadable code which when executed by a computer system causes thecomputer system to implement a method for customizing program content.The method implemented by the code includes modifying a programcomprising multiple program segments configured to be displayedsimultaneously utilizing data that includes an indication of whichsegments may be modified. Preferably, the data also includes thelocation, size or timing of the segments. Another embodiment is a systemfor customizing program content. The system includes a computer system,and an application program for modifying a program including multipleprogram segments configured to be displayed simultaneously utilizingdata that includes an indication of which segments may be modified.

DESCRIPTION OF THE DRAWINGS

The invention can be understood by reference to the Detailed Descriptionof the Invention when taken together with the attached drawings,wherein:

FIG. 1, is a screen shot showing nationally and locally generated screenwindows in accordance with an embodiment of the invention,

FIG. 2 is an example of MPEG aligned screen windows in which each screenwindow is a multiple of 16 in accordance with an embodiment of theinvention,

FIG. 3 is a diagram of a local content insertion system for graphics inaccordance with an embodiment of the invention,

FIG. 4 is a diagram of a local content insertion system for graphics andfull motion video in accordance with an embodiment of the invention,

FIG. 5 is a diagram of a screen layout and a screen control state matrixfor the screen layout in accordance with an embodiment of the invention,and

FIG. 6 is a diagram of a screen layout and a screen control state matrixincluding time data for the screen layout in accordance with anembodiment of the invention.

DETAILED DESCRIPTION OF THE INVENTION

Described are methods and systems for combining programming content in acontrolled synchronized manner. This allows the combined content to bedelivered simultaneously to users as part of a standard programmingsignal.

The present invention provides for the modification of major contentelements “downstream” from a program's original production. Thismodification can include insertion or replacement of content in theoriginal program. For example, an original program having centrallyproduced program elements can be created. Subsequent modification ofelements in this original program can then be made downstream, forexample at a local broadcast station or cable headend, in a coordinatedmanner.

To facilitate the modification of the centrally produced originalprogram, the downstream station preferably receives data indicatingwhere and when in the original program modifications can be made.

FIG. 1 is an example of the combination of nationally and locallygenerated screen windows displayed simultaneously as a combined program.In FIG. 1 the nationally generated live video and graphics aresurrounded by three locally generated graphic windows. The locallygenerated windows are specific to the New York area and include thecurrent weather conditions for New York, an identification of the localstation, and the hour-by-hour forecast for New York. Accordingly, aviewer of the combined program in FIG. 1 is able to get an overview ofthe weather across the nation along with more specific detailsconcerning weather in their area.

A local affiliate station or a cable headend preferably receives anoriginal national program feed in which the screen has been segmentedinto predetermined windows. Each of the windows in the original nationalprogram feed is preferably occupied by some nationally generated contentat all times. In this manner a local affiliate can choose to insertlocal content into one or more windows originally occupied by nationalcontent. By having all windows in originally occupied by nationalcontent, however, the local affiliate can choose to leave the nationalcontent unaltered without delivering an incomplete program to viewers.

To facilitate the modification of the centrally generated content toinclude locally generated content, the centrally generated content ispreferably distributed to the local facilities with data that indicateswhere the centrally generated content can be modified to include locallygenerated content. Additional data that can be distributed with thecentrally generated content can include the time in which the locallygenerated content can be inserted and the type of content to be insertedinto the centrally generated content.

Preferably, the centrally generated content is partitioned into windowsor segments. For example, in an embodiment suitable for digitaltelevision, the centrally generated content screen is partitioned intowindows with locations that correspond to the macroblock boundaries ofthe final digitally compressed stream, and a size that corresponds to aninteger number of macroblocks. A preferred type of digital stream is aMPEG-2 stream. In a MPEG-2 stream a macroblock is a 16×16 pixel area ofthe screen.

FIG. 2 shows an example of MPEG aligned screen windows in which eachwindow dimension is a multiple of 16. In FIG. 2, the main window iscentrally generated national content. Locally generated content is theninserted into one or more of the surrounding windows. By dimensioningthe screen windows in multiples of 16, the local content can easily bepositioned within the MPEG stream by modifying whole macroblocks withinthe original centrally generated stream.

FIG. 2 shows an embodiment in which the screen windows each includeseparately identifiable content. In this embodiment, each of the windowsmay or may not include a visually perceptible boundary around thewindow. In an alternative embodiment, the screen windows may not eachcontain separately identifiable content. In this embodiment, screenwindows in which locally inserted content can be inserted may beportions of centrally generated images that may modified. For example,the locally content may be placed around the boundaries of a centrallygenerated image by cropping the centrally generated image. The locationof the screen windows can then be used to identify which portions of thecentrally generated image may or may not be modified.

FIG. 3 shows an embodiment of a system for combining local content withcentrally generated content. The system allows for locally generatedgraphics, text and/or still images to be overlaid directly on anincoming digitally compressed (MPEG-2) stream.

In FIG. 3 integrated receiver descrambler (IRD) 300 receives anddescrambles centrally generated content 302. The centrally generatedcontent 302 preferably includes data which indicates what portion of thecentrally generated may be modified, for example by overlaying locallygenerated content. Locally generated content 306 generated and or storedon computer system 304 is transferred to a device 308 that is capable ofperforming compressed-domain logo insertion, for example, MPEGRemultiplexer devices such as the TERAYON CHERRYPICKER and the LEITCHDTP processor. Computer system 304 arranges the locally generatedcontent 306 to fit into one or more portions of the centrally generatedcontent that have been identified as modifiable. The MPEG Remultiplexer308 then places the locally generated content 306 into these portions ofthe centrally generated content.

The locally generated content on computer system 304 may be storedand/or retrieved from various memory devices connected to computersystem 304. These devices include a hard drive, flash memory, opticaldrives such as CR-ROM or CD-ROM R/W, DVD or other magnetic, optical,electronic or other media stores.

The MPEG Remultiplexer 308 also combines other MPEG encoded programsinto the DTV multiplex signal 312, such as a primary network programthat is MPEG encoded using encoder 310. Signal input and output fromMPEG Remultiplexer 308 may be may be in ASI “asynchronous serialinterface” (“ASF’) format (which refers to a DVB interface standard forcarrying an MPEG-2 compressed video signal on a coaxial cable) or anappropriate speed data link such as Ethernet or Firewire (IEEE 1394).The combined DTV multiplex signal 312 can subsequently be converted intoSMPTE 310 or other standard interface format at 314 before beingdelivered to an over-the-air transmitter via a Studio-Transmitter Link(STL) 316 and/or to a cable transmitter (not shown).

The automation and control of the combination of video streams can behandled by known computer system 318 properly configured. The computersystem may include at least one central processing unit or CPU(processor) connected to a host bus. The CPU may be any of varioustypes, including an x86 processor, e.g., a Pentium class, a PowerPCprocessor, a CPU from the SPARC family of RISC processors, as well asothers. The computer system may also include various memory mediums,typically including RAM and referred to as main memory. The main memorymay store one or more programs implementing the present invention. Themain memory may also store operating system software, as well as othersoftware for operation of the computer system.

This configuration creates an advantageous situation wherein thebroadcast network affiliate station or cable headend may receive acompressed digital television stream as a national feed, and locallygenerated graphics, text and/or still images from a computer can beinserted directly on top of the MPEG stream by an MPEG Remultiplexer.This can be used to avoid the need for decompressing and recompressingthe television signal. The data files can be transferred from thecomputer system 304 to the Remultiplexer using a standard PC networkconnection.

FIG. 4 shows an embodiment of a system for allowing a local broadcastnetwork affiliate station or cable headend to insert locally generatedvideo content and/or locally generated graphics, text or still imagesinto one or more of the modifiable segments in incoming centrallygenerated content. The system allows for the incoming compressedcentrally generated content to be decompressed to enable more complexprocessing.

In FIG. 4 centrally generated content is decompressed by IRD 400. Thecentrally generated content preferably includes data which indicates theposition of segments in the centrally generated content that can bemodified to include local content. The decompressed video signal 406 isdelivered to a multi-input keyer 402. In addition, locally generatedgraphic, text or still images 414 can be delivered to multi-input keyer402 from computer system 412. A local video server 404 can be used tosupply locally generated video content 408 to multi-input keyer 402. Thelocally generated video content 408 is preferably resized by scaler 410to fit into one or more of the modifiable segments in incoming centrallygenerated content.

In addition, the automation and control of the combination of the videostreams 324,408 and 406 can be handled by known computer system 416properly configured. The main memory of which may store one or moreprograms implementing the present invention.

The multi-input keyer allows the system to select which feed to use on asegment by segment basis according to the data supplied with thecentrally generated content. The resulting combined final DTV multiplexsignal 418 is created by MPEG Remultiplexer

420, including other MPEG programs, such as a primary network programthat is encoded using HD MPEG encoder 426. In the case of this basebandprocessing architecture example, the preferred macroblock alignmentdescribed previously remains beneficial for reducing the artifactsassociated with multiple compressions.

The combined DTV multiplex signal 418 can subsequently be converted intoSMPTE 310 or other standard interface format at 422 before beingdelivered to an over-the-air transmitter via a HDTV Studio-TransmitterLink (STL) 424 for delivery to viewers and/or to a cable transmitter(not shown).

Another aspect of this invention is the data that indicates what portionof the centrally generated video content may be modified. FIG. 5 showsone embodiment in which the data is organized into a screen controlstate matrix. As shown in FIG. 5, the matrix can be a simple tableincluding a numerical list of windows in a screen layout. The windowscorrespond to portions of the screen. A simple binary entry can be usedto indicate whether national or local content can be in each window. Forexample, a 1 can be used to indicate that the national content can bereplaced with local content. In addition to local and national content,other indicators may be extended to specify whether “content” or“advertising” should be placed in each window.

FIG. 6 shows an embodiment in which the screen control state matrix isfurther extended to include a description of the window locations andsizes, in order to allow flexible reformatting of the screen. In orderto allow accurate time synchronization of events, the matrix may alsoinclude a time indicator for when the state should first be applied. Inaddition, the screen states may be specified not only in binary ornumerical form, but in many possible syntaxes, such as XML descriptors.Although not shown, the matrix may also specify whether the audioportion of the program may also be modified.

Preferably, the control state matrix or other data that indicates whatportion of the centrally generated content may be modified isdistributed in-band with the centrally generated content. For example,in the case where the national feed is an MPEG-2 compressed signal, thedata may be multiplexed into the MPEG stream using any of severaltechniques, including the use of private user data or as extensions tothe SCTE 35 Digital Program Insertion protocol. For analog television,the data may be encoded into the vertical blanking interval (VBI) orhorizontal blanking interval (HBI). In addition, data may also be sentby out-of-band means such as by Internet or other data network delivery.

Although the above description is provided in the context of a nationaland local television broadcast, one of ordinary skill in the art wouldrealized that the invention is not limited to these embodiments. Forexample, the invention could be used to efficiently modify anycombination of content streams including internet content, radio contentand digital radio content.

The above description is presented to enable a person skilled in the artto make and use the invention, and is provided in the context of aparticular application and its requirements. Various modifications tothe preferred embodiments will be readily apparent to those skilled inthe art, and the generic principles defined herein may be applied toother embodiments and applications without departing from the spirit andscope of the invention. Thus, this invention is not intended to belimited to the embodiments shown, but is to be accorded the widest scopeconsistent with the principles and features disclosed herein.

The invention claimed is:
 1. A method of distributing customizableprogram content, comprising: distributing, via a first distributor to asecond distributor, a program comprising multiple program segmentsconfigured to be displayed spatially adjacent to one another ondifferent portions of a display, wherein each segment of the multipleprogram segments is related to a program content; and distributingmodification permission data that indicates one or more segments of themultiple program segments that can be replaced by the second distributorwith replacement content to enable customized program content to bedistributed to a plurality of user devices by the second distributor. 2.The method of claim 1, wherein the program comprises national broadcastcontent and the replacement content comprises local content, and thecustomized program content comprises the local content and at least aportion of the national broadcast content.
 3. The method of claim 2,wherein the modification permission data comprises a screen controlstate matrix that binarily indicates the one or more segments of themultiple program segments that can be replaced with the local content bythe second distributor.
 4. The method of claim 3, wherein the screencontrol state matrix further indicates a time at which the local contentis to replace the one or more segments.
 5. The method of claim 1,wherein the second distributor is different from a set top box.
 6. Themethod of claim 1, wherein the second distributor is a networkaffiliate.
 7. The method of claim 1, wherein the program and themodification permission data are distributed via a common broadcastsignal.
 8. The method of claim 7, wherein the common broadcast signal isin a MPEG-2 format.
 9. The method of claim 7, wherein the commonbroadcast signal is in a compressed format.
 10. A method of customizingprogram content, comprising: receiving, from a first distributor, at asecond distributor, a program comprising multiple program segmentsconfigured to be displayed spatially adjacent to one another ondifferent portions of a display, wherein each segment of the multipleprogram segments is related to a program content; receiving modificationpermission data that indicates one or more segments of the multipleprogram segments that can be replaced by the second distributor withreplacement content to enable customized program content to bedistributed to a plurality of user devices; generating the customizedprogram content by replacing one or more of the one or more segments ofthe multiple program segments that can be replaced with the replacementcontent; and distributing the customized program content to theplurality of user devices.
 11. The method of claim 10, wherein theprogram comprises national broadcast content and the replacement contentcomprises local content, and the customized program content comprisesthe local content and at least a portion of the national broadcastcontent.
 12. The method of claim 11, wherein the modification permissiondata comprises a screen control state matrix that binarily indicates theone or more segments of the multiple program segments that can bereplaced with the local content by the second distributor.
 13. Themethod of claim 12, wherein the screen control state matrix furtherindicates a time at which the local content is to replace the one ormore segments.
 14. The method of claim 10, wherein the seconddistributor is different from a set top box.
 15. The method of claim 10,wherein the second distributor is a network affiliate.
 16. The method ofclaim 10, wherein the program and the modification permission data aredistributed via a common broadcast signal.
 17. The method of claim 16,wherein the common broadcast signal is in a MPEG-2 format.
 18. Themethod of claim 16, wherein the common broadcast signal is in acompressed format.
 19. A tangible, non-transitory, machine-readablemedium, comprising machine-readable instructions that, when executed byone or more processors, cause the one or more processors to: distribute,via a first distributor to a second distributor, a program comprisingmultiple program segments configured to be displayed spatially adjacentto one another on different portions of a display, wherein each segmentof the multiple program segments is related to a program content; anddistribute modification permission data that indicates one or moresegments of the multiple program segments that can be replaced by thesecond distributor with replacement content to enable customized programcontent to be distributed to a plurality of user devices by the seconddistributor.
 20. The machine-readable medium of claim 19, wherein theprogram comprises national broadcast content and the replacement contentcomprises local content, and the customized program content comprisesthe local content and at least a portion of the national broadcastcontent.
 21. The machine-readable medium of claim 20, wherein themodification permission data comprises a screen control state matrixthat binarily indicates the one or more segments of the multiple programsegments that can be replaced with the local content by the seconddistributor.
 22. The machine-readable medium of claim 21, wherein thescreen control state matrix further indicates a time at which the localcontent is to replace the one or more segments.
 23. The machine-readablemedium of claim 19, wherein the second distributor is different from aset top box.
 24. The machine-readable medium of claim 19, wherein thefirst distributor is a national network affiliate.
 25. Themachine-readable medium of claim 19, wherein the second distributor is alocal network affiliate.
 26. A tangible, non-transitory,machine-readable medium, comprising machine-readable instructions that,when executed by one or more processors, cause the one or moreprocessors to: receive, from a first distributor, at a seconddistributor, a program comprising multiple program segments configuredto be displayed spatially adjacent to one another on different portionsof a display, wherein each segment of the multiple program segments isrelated to a program content; receive modification permission data thatindicates one or more segments of the multiple program segments that canbe replaced by the second distributor with replacement content to enablecustomized program content to be distributed to a plurality of userdevices; generate the customized program content by replacing one ormore of the one or more segments of the multiple program segments thatcan be replaced with the replacement content; and distribute thecustomized program content to the plurality of user devices.
 27. Themachine-readable medium of claim 26, wherein the program comprisesnational broadcast content and the replacement content comprises localcontent, and the customized program content comprises the local contentand at least a portion of the national broadcast content.
 28. Themachine-readable medium of claim 27, wherein the modification permissiondata comprises a screen control state matrix that binarily indicates theone or more segments of the multiple program segments that can bereplaced with the local content by the second distributor.
 29. Themachine-readable medium of claim 28, wherein the screen control statematrix further indicates a time at which the local content is to replacethe one or more segments.
 30. The machine-readable medium of claim 26,wherein the second distributor is different from a set top box.
 31. Themachine-readable medium of claim 26, wherein the second distributor is anetwork affiliate.
 32. The machine-readable medium of claim 26, whereinthe program and the modification permission data are distributed via acommon broadcast signal.